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The theory of random real numbers is exceedingly well-developed, and fascinating from 
many points of view. It is also quite challenging mathematically. The present notes are intended 
as no more than a gateway to the larger theory. They review just the most elementary part of 
the theory (bearing on Kolmogorov- and Martin-Lof-randomness). We hope that the simple 
arguments presented here will encourage the en terprising student to examine ric her treatments 

Comments 



of the subject available elsewhere, notably, in 
and corrections to the notes are, of course, welcome. 
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1 Notation and other preliminaries 

Let N = {0, 1, 2, . . .}. By a sequence we mean an infinite sequence ordered like N. Given 
n G N and infinite sequence x, we use x(n) to denote the nth member of x, and x[n] to denote 
the initial finite sequence of length n in x. So x[0] is the empty sequence. An infinite sequence 
over {0, 1} is called a real. Let B be the set of finite binary strings. The concatenation of 
b, c G B is denoted b * c. For n G N, 1™ denotes n l's in a row. The length of b G B is denoted 
\b\. For b G B and infinite binary sequence x we write b C x, just in case there is an n G N with 
b = x[n]. Similarly, for a, b G B we write b C a, just in case b is an initial segment of a. For 
b G B, 0(b) denotes the set of reals that begin with b. For B C B, 0(B) = {0(b) : b G B}. 
All uses of log are base 2. 



'Contact: osherson@princeton.edu, weinstein@cis.upenn.edvL 

'One small conceptual contribution to the theory is offered in losherson and Weinstein! 1 20081) . 
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We fix an effective enumeration r(m) of B, m G N. Members of B are enumerated accord- 
ing to length with ties broken lexicographically. 



(1) Lemma: For all m G N, |r(m)| < log(m + 1). 



(2) Definition: Let Q C B be given. We say that Q is closed under subsequences just 
in case for all b G Q, a G Q for every a C 6. 



For proof of the the following well-known result see lBoolos. Burgess, and Jeffreyl (120021 . pp. 
323-324). 

(3) Lemma: (Konig) Let Q C B be infinite and closed under subsequences. Then there 
is a real x such that x[n] G Q for all n. 

We sometimes identify a real x (as understood here as an infinite sequence over {0, 1}) with 
a real number in the interval [0, 1] via the map I that sends x to Ya^Lo ' 2~(* +1 ) . Similarly, 
we may identify the finite initial segment x[n] with the rational number Y17=o X ^S) ' 2~(' +1 ). 
Any such finite sum yields a rational number called dyadic. Observe that J -1 is well-defined 
for all reals in [0, 1] aside from the positive dyadic rationals. Indeed, each dyadic rational 
besides is the I image of exactly two infinite binary sequences. One of the sequences ends in 
a tail of 0's, the other in a tail of l's. For example, the real number | equals both 7(111000 • • • ) 
and 7(110111 • • • )- When mapping real numbers into real binary sequences, we must therefore 
choose between the two kinds of tails. The theory below can be developed on the basis of either 
choice. We prefer the latter. 

(4) Convention: For every positive, dyadic rational number r, we take its representation 
as a sequence over {0, 1} to end in an infinite sequence of l's. 

The convention resolves all ambiguity; every other real number has a unique inverse image 
under I. 

It is tempting to introduce notation that distinguishes between "reals" in the sense of se- 
quences over {0, 1} from "reals" in the sense of numbers (points on the real line). We bow to 
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custom, however, and rely on context to clarify whether "real" is used in one sense or the other. 
Note that whenever a statement involves an inequality (or weak inequality) then the map I is 
used implicitly. Similarly, when a real number x is juxtaposed with [n] to form x[n] then we 
have first implicitly applied I^ 1 to x to produce a sequence over {0, 1}. The following lemma 
makes use of these conventions, and codifies a few well-known facts that we will refer to in 
later sections. 

(5) Lemma: 

i=n+l v 7 v 

(b) For all reals x and all n£N, x[n] < x < x[n] + 2~ n . 

(c) For every real number x G (0, 1], x[n] < x. 

(d) For all n G N, J2i<n 2 ' = 2 n - 1. 

Proof: Fact © is an immediate consequence of the following well-known identity by setting 

r = 1/2. 

oo 

For every real number < r < 1 and n G N, (1 — r) • r l = r n . 

i=n 

Fact (© follows immediately from ©. 



Fact (jcj) follows from Convention [(4)] concerning the identification of real numbers in (0, 1] 
with infinite binary sequences which are not eventually constantly 0. 

Fact © is easily proved by induction. □ 



2 Kolmogorov complexity 

Let Wj index the computably enumerable subsets of B (instead of indexing the computably 
enumerable subsets of N, which is more usual). The indexes on the Wi are qualified as "r.e." 
(recursively enumerable). 

We use TM to abbreviate "Turing Machine." Members of B are conceived to be the inputs 
and outputs of TMs. Let M be a TM, and let a, b G B be given. We write M (a) = b just in 
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case M started with a on its tape halts with b on its tape. We write TM (6) J. to signify that 
TM(6) is so denned, and TM(6) f to signify that it is undefined. Via a fixed, effective bijection 
between B and the set of TMs, TMs are themselves taken to be members of B. TMs thus inherit 
the ordering imposed above on B. 

We write Cm(&) to be the length of a shortest c <E B such that M (c) = b; CM{b) = oo if no 
c G B is such that M(c) = b; this number is known as the "plain Kolmogorov complexity" of 
b relative to M. 



(6) Definition: TM M is called universal just in case for every TM L there is k G N 
such that C M (b) <C L (b) + k for all b G B. 



Note that the definition implies that Cm(&) is finite for every b G B if M is universal. It's also 



worth observing that "universal" in the sense of Definition |(6)| does not yield the same set of 
machines as "universal" in Turing's original sense. 



(7) Lemma: Universal TMs exist. 



Proof: Let A be a lexicographical ordering of all TMs. It follows immediately from the exis- 
tence of universal machines in Turing's sense that there is a TM U such that for all n G N and 
d G B, U(l n 0d) = L(d), where L = A(n). To verify that U is universal, let TM L be given, 
and let n be such that L = A(n). Then for all b € B, Cu(b) <C L {b)+n + l. □ 

In light of the lemma, we fix a universal TM U, and we write C(b) in place of Cu{b). Let 
L be the TM that halts immediately, making no changes to its tape. Then for all b G B, 
Cb{b) = \b\. Because U is universal there is m G N such that C(b) < Cz(b) + m. It follows at 
once that: 

(8) Lemma: There ism e N such that for every b G B, C(b) < \b\ + m. 



3 A fact about short instructions 



An input to U can be conceived as instructions for producing an output. Inputs that are the 
shortest possible for producing their output are called short. Officially: 
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(9) Definition: Call p G B short if U(p) I, and for all q G B, if U(p) = U(q) then 

\p\ < \q\- 

Equivalently: 

(10) p G B is short iff C(f7(p)) = |p|. 

(11) PROPOSITION: There is no effective enumeration of an infinite number of short mem- 
bers of B. 



Proof: We follow iLi and Vitanyil (119971 . p. 121). For a contradiction, let pi, i G N be an enu- 
meration of infinitely many short members of B. Then by |(10)[ {C(pi) : i G N} is unbounded. 
Therefore, the following function, g : B — > B, is total and computable. 

For all m G N, g{r{m)) = pi where i is least such that C(pi) > m. 

By the definition of g, we have: 

(12) for all m e N, C0(r(m))) > m. 

Suppose that TM L computes g. Then by the universality of the reference machine U there is 
k G N such that: 

(13) for all m G N, C(g(r{m))) < C L (g(r(m))) + A;. 



Also, since the string r(m) causes L to produce g(T(m)), and by Lemma (1) 

(14) for all m G N,C L (g{r(m))) < |r(m)| < log(m + 1) + 1. 
From [0211 and [(T3)| 

(15) for all m G N, m < C L (g{T(m))) + fc. 
And from [(14)1 and [(15) 



for all m G N, m < log(?n + 1) + k + 1 
which is false no matter which k G N is chosen. 



□ 



4 Failure of a plausible account of randomness 

A promising idea is to qualify real x as random just in case cofinitely many of x's initial 
segments have high complexity. In this section we specify this idea and show how it comes to 
grief. 

(16) Definition: Call b G B incompressible just in case C (b) > \b\. 

Since there are 2 n binary strings of length n and only Yli< n 2* = 2™ — 1 inputs to U of length 
less than n [see |(53ffl , it follows that: 

(17) Lemma: For every n G N there are incompressible b G B with \b\ = n. 

(18) Definition: Call a real x incompressible almost always just in case 

{n : x[n] is incompressible} 
is cofinite. 

We might hope that the set of reals that are incompressible almost always is rich and numerous, 
but it turns out to be empty! We'll derive this surprising fact as a corollary to the following 
proposition. 

(19) Proposition: For all real x and all k G N there is n G N such that C(x[n}) < n - k. 
To prove the proposition, we start with a lemma. 

(20) Lemma: Let total recursive function / : B — > B be given. Then there is k € N such 
that for all b € B, C(/(6)) < C(b) + k. 

Proof: Recall that U is our fixed universal TM, and let TM L be such that: 

(21) for all a G B, L{a) = f(U(a)). 
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By Definition [(6)1 let k G N be such that: 

(22) for all c G B, C(c) < C L (c) + fc. 

Let 6 G B be given, and let a G B be of shortest length with U (a) = 6. Hence: 

(23) C{b) = \a\. 

By |(2I)1 i(a) = /(&), hence: 

(24) C L (/(b)) < |a|. 

Byp271andp4)l C(/(6)) < C L (f(b)) + k<\a\ + k, so by|(23)l C(f(b)) < C(b) + fc. □ 

Proof of Proposition \(19)\ Recall that r(-) is an effective bijection between N and B. Let 
effective / : B -> B be such that for all b G B, /(&) = r(|6|) * b. By Lemma |(20)1 there is 



fc G N such that for all b G B, C(f(b)) < C(b) + fc . So by Lemma p)l there is k\ G N such 
that for all 6 G B, C(/(6)) < |6| + k\. Thus: 

(25) for all b G B, C(r(|6|) * 6) < |6| + k v 

Now let real x and k G N be given. To prove the proposition we must exhibit n G N such 
that: 

(26) C(x[n]) <n-k. 

Choose p G N such that r(p) C x and \r(p) \ > k\ + k. (That there is such a p is obvious.) Let 
b G B be the p bits of x following r(p), and let n be the length of r(p) * b. Thus: 

(27) (a) \b\ =p 

(b) s[n] = r(p)*6 = r(|6|)*6 

(c) |fcr(|&|)| = \r(p)\>k l + k 

(d) \x[n} \ = |r(|6|)*&| = \t(j>)\ + \b\> h + k+p 
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By |(27)1 and 



(25) 



C(x[n]) = C(r(\b\)*b) < \b\ + h = p + hi = (fci + A; + p) - k < \x[n} \ - k 



which verifies [(26)] 



□ 



(28) Corollary: No real is incompressible almost always. 
Proof: Suppose for a contradiction that real x is incompressible almost always. Then 



is well defined. It follows that for all n £ N, C(x[n]) > n — k, contradicting Proposition |(19)[ 



5 No subadditivity for C 

The following proposition is meant to deepen the conviction that C is not the right measure of 
complexity for finite sequences. (But we admit to not understanding why this feature of C is 
considered a defect.) 



(29) Proposition: For every I e N, there are a, b € B such that C(a * b) > C(a) + 
C{b) + L 



To prove the proposition, we start with two lemmas. 

(30) Lemma: Let P C B and suppose that for all real x there is an n € N such that 
x[n] G P. Then, there is an m € N such that for all real x there is an n < m such that 

x[n] G P. 

Proof of Lemma \(30)\ Suppose that 

(31) for every m G N there is an x such that for all n < m x[n] g" P. 



k = 2,{* + C ( x [i]) '• x [i] i s not incompressible } 




□ 



8 



Let Q = {a G B | V6(6 Co->6^ P}. It follows from |(31)| that Q is infinite and closed under 
subsequences. Therefore, by Lemma [(3)] there is a real x such that for all n G N x[n] G Q. 
Since Q C P, this contradicts the hypothesis of |(30)[ □ 

(32) Definition: Call b G B ^-compressible just in case C (6) < |6| - fc. 

(33) LEMMA: For every A; € N, there is an m G N such that for every a G B, if \a\ > m, 
then there is d C a such that d is A;-compressible. 



Proof: Fix and let P C B be the collection of fc-compressible sequences. Proposition |(19)| 
guarantees that for every real x there is an n such that x[n] € -P. The lemma now follows at 
once from Lemma [(30)| □ 

Proof of Proposition \(29)\ Fix t G TV. By Lemma [(8)| choose m so that for every b G B, 
< |6| + m. Let k = I + m. By Lemmas (17) and |(33)[ we may choose an incompressible 



a G B and d C a with d /c-compressible. Let 6 be such that a = d*b. Then 

C(d*b) =C(a) > |a| = |d*6| = |d| + |b| > C{d) + k + \b\ 
> C(d) + m + £ + C(b) - m = C(d) + C{b) + t. 



□ 



6 Prefix-free sets 

The defects in plain Kolmogorov complexity lead to an approach based on "prefix-free" subsets 
of B. 

(34) Definition: 

(a) S C B is prefix-free just in case for all a, b G S, neither a C b nor b C a. 

(b) A TM L is prefix-free just in case domain (L) is prefix-free [that is, for all b G B 

and c C b, L(b)i implies L(c)f]. 
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(35) Example: T = {b G B : for some n G N, 6 = l n *0*a with |a| = re} is prefix-free, 
infinite, and effectively enumerable. 

(36) Lemma: For every r.e. S C B there is an r.e. T C B such that 

(a) 0(5) = 0(T) and 

(b) T is prefix-free. 

Moreover, an index for T can be found uniformly effectively from an index for 5. 

Proof: Given a recursive enumeration so, s±, . . . of S, T can be constructed by the following 
induction which effectively constructs a chain T C T\ C • • • C B with T = UjTj. (If S = 
then the construction will deliver an index for 0.) Basis : To = {so}. Induction step: Suppose 
the induction has been completed through stage n. Let T n be the subset of T already defined. If 
s n+ \ is neither a suffix nor prefix of any t € T n then T n+ \ = T n U {s n+ {\. If for some i G T n , 
extends i then T n+ \ = T n . If for some t G T n , t extends s n+ i then T n+ i = T n U Z 
where Z is defined as follows. Let k be the length of the longest sequence in T n . Let 

Z = {t G B : \t\ = k, s n+1 C t and W G T n , t' £ t}. 

It is easy to see that the T constructed in this way satisfies the conditions of the lemma. □ 
The following lemma is proved in '. 



Li and Vitanvi 



(I1997L p. 74). 



(37) Lemma: (Kraft) Let £i be a sequence of natural numbers. There is a prefix-free 
subset of B with this sequence as lengths of its members iff 



Here is an effective version, proved in lDowney and Hirschfeldtl (120 lOl . Thm. 3.6.1, p. 125). 



(38) Lemma: Let li be a recursive enumeration of lengths such that 
< 1. 

i 

Then there is a recursive enumeration ai of a prefix-free set such that \ai\ = li. 
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7 Prefix-free complexity 

Given a prefix-free TM L and b G B, we let /Cl(&) be the length of a shortest a G B such that 
L(a) = b; in the absence of any such a JCl(P) = oo. 

(39) Definition: A TM V is prefix-free universal just in case V is prefix-free and for 
every prefix-free TM L there is a constant k G N such that for all b G B, /Cy(fe) < 
/C L (6) + fc. 

(40) Proposition: Prefix-free universal TMs exist. 

Proof: It is easy to verify the existence of a uniform-effective procedure P operating on TMs 
such that for all machines M: 

(a) P{M) is prefix-free. 

(b) P(M) computes the same function as M, if M is prefix-free. 

Recall from Section[TJour effective ordering Lj of the TMs. Let TM V be such V (l~*0*a) = 
P(Li)(a) for all £ G N and be undefined for inputs of any other form. To see that V is prefix- 
free, suppose that a, b G B were such that a C b and both V(a) J, and V(6) 4- ■ Then for some 
i G N, a and 6 have the forms 1 £ * * c and l e * * d, respectively, with c C d. But then 
P(L^)(c)4 and P(L^)(d)4_, contradicting the prefix-free nature of P{L^). 

To finish the proof, let £ be the least index of prefix-free TM L. Then, for all a, b G B, 
L(a) = b implies V(l e * * a) = P{Lg){a) = L(a) = b. Hence, for all prefix-free TMs L 
with smallest index index I, K, v {b) <K, L (b) + l + l for all b G B. □ 

In light of the proposition, we fix a universal prefix-free TM V, and we write K{b) in place 
of K.y(b). It is clear that for every b G B there is a prefix-free TM L with L(b) = b. We infer 
immediately that: 

(41) Lemma: The range of V is B. 
Hence, K(b) is defined for all b G B. 
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8 Short JC programs 

(42) Definition: Call p G B prefix-free short if V(p) I and for all q G B, if V(p) = 
V(q) then \p\ < \q\. 

(43) PROPOSITION: There is no effective enumeration of an infinite number of prefix-free 
short members of B. 



Proof: The argument is parallel to that for Proposition |( 11) Let T = {l n : n G N}. Then T 



is prefix-free, infinite, and effectively enumerable by increasing length, say, as t$. So: 

(44) for all m G N, \t m \ = m + 1. 

For a contradiction, let pj, i £ N be an effective enumeration of infinitely many prefix-free 
short members of B. Of course, {K,(pi) : i € N} is unbounded. So the following function 
tp : T — > B is computable. 

(45) For all m € N, ip(t m ) = pi, where i is least such that K,{pi) > 2m. 
By the definition of ip: 

(46) for all m € N, )C(tjj(t m )) > 2m. 

Suppose that TM L computes ip. Then domain(L) = T is prefix-free, so by Definition |(39)| 
there is € N such that: 

(47) for all m G N, /C(^(i m )) < K L {^{t m )) + A;. 
Also, since i m causes L to produce tp(t m ), and by |(44)[ 

(48) for all m G N, K, L {^{t m )) < \t m \ = m + 1. 
From [(46)1 and [(47)| 
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(49) for all m G N, 2m < K L (^(t m )) + k. 
And from [(48)1 and [(49)| 

for all m G N, 2m < m + 1 + k, 
which is false no matter which k £ N is chosen. □ 

9 Subadditivity for K, 



In contrast to Proposition |(29)[ we have 



(50) Proposition: There is k € N such that for all a, b £ B, IC(a-kb) < K,{a) + K,(b) + k. 

As a preliminary to the proof, let a, b,c,d,e € B be such that b = a* c and b = d* e with 
a ^ d (hence, c 7^ e). Then no prefix-free TM can be denned on both a and d because one is a 
subsequence of the other. Since V is prefix-free, we thus have: 

(51) LEMMA: For all b G B there is at most one pair a,c G B such that b = a * c, 
V (a) J, and V(c) 4- • Moreover, if such a pair a, c exists, it can be found effectively (via 
dovetailing). 



Proof of Proposition \(50)\ By Lemma 1(51)1 letTM L be such that for all b G B, L(i>) 



V(a) * V(c) for the unique a, c G B such that b = a * c, V(a) |, and V(c) I ; if no such 
a, c exist then L(b) t- To show that L is prefix-free, suppose that b, b' G B were such that 
b' C 6, L{b) i , and L(fo') | . Then there are a, c and a', c' such that b = a * c, V (a) J, , V(c) | , 
b' = a' * d , V(a') | , V(c') I , and either a C a', a' C a, c C c' or c' C c. But this implies that 
V is not prefix-free, contradiction. Since L is prefix-free, by Definition [(39)] let k G N be such 
that: 

(52) for all c G B, JC(c) < K. L {c) + k. 
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Now let a, b G B be given. Let p, q G B have shortest lengths such that V(p) = a and 
V (q) = b, respectively. [That such p, q exist follows from Lemma [(41)| ] Then by the definition 
of L, 



(53) L{p *q) = V(p) * V(q) =a*b. 

By[(52)}/C(a*&) < /C L (a*6) + k. By[(53)j JC L (a*b) + k < |p*?| + jfe= |p| + [ ff | + jfe. And 
by the choice of p, q, \p\ + \q\ + k = K{a) + K(b) + k. Therefore, JC(a*b) < K(a) + K{b) + k. 
□ 



10 Chaitin's halting probability 

Recall that V is our reference prefix-free universal TM. We define the halting probability, f2, 
as follows. 



(54) Definition: 

ft = ^{2~l 6 l :feGBandy(6)|}. 



By Lemma |(4"T)| O > since {b € B : V{b) | } / 0. On the other hand, by Lemma pT)] Q, < 1 
inasmuch as domain (V) is prefix-free. So f2 may be conceived as a probability, namely, as the 
chance of hitting a sequence in domain(V) by flipping a fair coin. Note that the numerical 
value of Q depends on the choice V of reference universal Turing Machine. 

Define P„ = {b G B : | 6| < n and V(b) j\. Of course, for all n £ N, P n is finite. 
Following the development in lLi and Vitanyil (119971 . p. 217) (but with some modifications), we 
now establish: 



(55) Lemma: There is a computable function tp from B to finite subsets of B such that for 

all n £ N, V(^N) = Pn- 



Proof: First we demonstrate: 



(56) Let X C domain (V) and suppose that ^{2"l b l :kl}> n[n]. Then P n C X. 
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For a contradiction, suppose that P n % X. Then, for some b G domain (V) with |6| < n, 
b X. Since X C domain (V) it follows that: 

(57) £{2-l 6 l :6el}<n- 2~ n . 

ButbyP)E), - 2_n < ^Ni which with |(57)| contradicts the assumption ^]{2~I 6 I : b G 



X} > Q[n], proving [(56) 



It was noted above that 17 > [indeed, Lemma [(4 1 )| implies that domain (V) is infinite]. 
Therefore, by |(5)| |c]) for every re G N, Q > U[n]. It follows at once that: 



(58) For every n E N there is a finite subset X of domain (V) such that ^{2 6 ' : 6 G 
X} > n[ra]. 

Now let us describe how to compute ifi. Given a G B, use dovetailing to enumerate 
domain (V). Let X C domain (V) be the first finite subset that emerges from the enumera- 
tion with the property that J]{2~I 6 I : b £ X} > a. [If no such X is found then ip(a) t-] Set 
</,(a) = {6 e X : |6| < |a|}. 



Let n G N be given. To finish the proof of Lemma [(55 )[ we show that ip(S}[n]) = P n . By 
|(58)[ the enumeration of domain(V) yields a finite subset X such that ^{2~l fe l : b G X} > 
0[n]. By |(56)[ P n C X. Since P n contains the members of domain(V) with length bounded 

by n, ip{Q[n]) = {b G X : \b\ < \ fl[n]\} = {b G X : |b| < n} = P n . □ 



(59) Corollary: Q is not computable. That is, the function mapping n G N to Jl(n) is 
not effective. 



Proof: Suppose for a contradiction that Q is computable. Then Lemma [(55 ) | implies that P n 
is computable from re. The set P = {p G B : V(p) i } is therefore decidable. (Given b G B, 
6 G P iff 6 G P|6|-) We may therefore enumerate P in order of increasing length. Thus, we can 
effectively enumerate the set 5 of pj G P such that for no i < j, V(pi) = V(pj). Each such 
Pj is prefix-free short in the sense of Definition |(42)[ Since range(V) is infinite, it is clear that 
S is infinite. Such an enumeration is impossible by Proposition |(43)| □ 

Since all rational reals are computable, we also have: 
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(60) Corollary: $7 is irrational. In particular, O < 1. 



Now we show the pivotal fact: 



(61) Proposition: There is a constant k such that for all n G N, JC(Q[n]) > n - k. 

Proof: From Lemma |(55)| it follows that there is computable tp : B — > B such that for all 
n G N, <p{Sl[n\) G range(V), and for all b G B, <p(Q[n]) = |b| > n. Informally, 

ip is computed as follows. Given Q[n], compute P n then compute X = {V(b) : b G P n }. 
Enumerate the range of V until the first a G B appears that is not in X. Set ip(fl[n]) = a. 
Hence: 



(62) For all n G iV, /C(</?(ft[n])) > n. 



Let TM L be such that for all b G B, L(6) = <p(V(b)) with L(6) t if V(b) t- Then L is 
prefix-free because V is. Note that if V(b) = Q[n] then L(b) = ip(fl[n]). It follows that: 



(63) For all n G N, /C L (^(0[n])) < K(Q[n]). 



Since L is prefix-free, by Definition (39) let k G N be such that: 



(64) For all n G N, K(p{Q.[n])) < K L (ip(n[n])) + k. 
It follows at once from |(63)| and |(64)| that: 

(65) For all n G N, K{p{Q,[n])) < K{Q[n\) + k. 
From |(62)1 and |(65)] we obtain 

For all n G N, n < K(Sl[n]) + k. 
which implies Proposition [(61)] □ 



(66) Definition: Any real x for which there is a constant k such that for all n G N, 
JC(x[n]) > n — k is called random in the sense of Kolmogorov. 
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Proposition |(6 1 ) | thus shows: 

(67) COROLLARY: There are reals that are random in the sense of Kolmogorov. 

Later we'll see that the set of such reals has measure 1. 

Notice that Definition |(39)| implies that the class of reals that are random in the sense of 
Kolmogorov is invariant under different choices of prefix-free universal TM. 



11 Martin-Lof tests in sense 1 



With minor differences, we start by following (ILi and Vitanyil . 119971 . p. 14 Iff.). All prob- 
abilities in what follows are with respect to the uniform product measure (i.e., the coin flip 
measure). Given S C B, let O(S) be the set of reals that start with some a G S. To reduce 
clutter, we rely on the following convention. 

(68) Convention: Given S C B, we write Pr(S) for Pr(0(S)). 

The following lemma reflects the fact that members of a prefix-free subset of B dominate non- 
intersecting neighborhoods of the Cantor Space. 

(69) Lemma: Let X C B be prefix-free. Then Pr(X) = T, b &x 2 ~ W - 

For a function /, we write f(x) 1= y to mean that f{x) is defined and equals y (and 
similarly for inequalities). 



(70) Definition: Any partial recursive function t : B — > N is called a Martin-Lof test 
(in sense 1) provided that for all m G N, 

Pr{b G B : t(b)i> m} < 2~ m . 

(71) Example: Let t : B — > N count the length of the initial sequence of 0's in a given 
x G B. Then t is a Martin-Lof test because for each m G N, the set of reals that 
begin with at least m 0's has probability 2 _m . (For example, the probability of a real 
beginning with three 0's is 1/8.) 
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To clarify notation, let us expand the foregoing example. Given m G N, S = {b G B : t(b) J, 
> m} is a subset of B. To calculate the probability of S, we consider the set of reals x 
that extend some member of S, that is, we consider the set O(S). The relevant condition is 
therefore that Pr(0(S)) < 2~ m . Relying on Convention |(68)[ the latter inequality is written 

as Pr(S) < 2~ m . 

(72) Example: Let t : B — > N count the number of consecutive even positions in a given 
b G B that are filled with l's starting from position 0. For m = 3, the probability of 
a real beginning with 1_1_1 is 1/8, and more generally, the probability of beginning 
with at least m l's in even position is 2~ m . So t is a Martin-L6f test. 

(73) Example: Let t : B — > N count the number of times 101 appears in a given binary 
sequence. Then t is not a Martin-Lof test. Indeed, for m = 3, the probability of a real 
containing at least m occurrences of 101 is unity (which exceeds 1/8). 

(74) Example: Let t : B — > N count the number of consecutive 0's just after the initial 
segment 111 if it occurs. Then t is a Martin-Lof test even though t is partial. For each 
m G N, the set of reals that begin with at least m 0's following the initial sequence 
111 has probability 2" m+3 . 

Since t can be any partial recursive function, the collection of Martin-Lof tests captures all 
sufficiently rare patterns that can be mechanically detected in binary sequences. The idea of 
"sufficient rareness" is given by the condition 

Pr{b G B : t(b)i> m} < 2~ m 

in Definition [(70)| 

(75) Definition: Let a Martin-Lof test t and a real x be given. We say that x passes t if 
{i(x[ra]) : n G N and t(a;[n])!} is bounded. Otherwise, x fails t. 

The idea is that x passes t if x doesn't manifest ever more improbable events according to t 
(namely, with probabilities declining as 2" m ). 
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(76) Example: Let t be as in Example [(7 2) | Then a real x passes t if and only if x(2n) = 
for some n € N. 



(77) Definition: A real x is Martin-Lof random (in sense 1) just in case x passes every 
Martin-Lof test (in sense 1). 

12 Martin-Lof tests in sense 2 

(78) Definition: Let function / : N — s> N be total recursive. Then / is a Martin-Lof 
test (in sense 2) provided that for all n G N, Pr(W f ^) < 2~ n . 

(79) Definition: Let / be a Martin-Lof test in sense 2. A real x passes / just in case 
x & (~){0(Wf( n )) ■ n G N}, and x fails / otherwise). We call x Martin-Lof random 
(in sense 2) if x passes all Martin-Lof tests (in sense 2). 

(80) Proposition: If a real is Martin-Lof random in sense 2 then it is Martin-Lof random 
in sense 1 . 

Proof: Suppose that real x fails Martin-Lof test t in sense 1 [Definition |(70)[ . We must exhibit 
a Martin-Lof test / in sense 2 [Definition |(78)[ that x fails. 

Let total recursive / : N — > N be such that /(0) is an r.e. index for B, and for all n > 0, 
W f(n) =\J{t~Hm):m>n}. 

Because t is partial recursive, it is clear that such an / exists. To see that / is a Martin-Lof 
test in sense 2, suppose for a contradiction that for some n > 0, Pr{Wfi n )) > 2~ n . Then 
Pr(U{i _1 ( m ) : m > n l) > 2 ~™> hence: 

(81) Pr{b G B : t(b)X> n} > 2~ n . 

B ut |( 8 1 ) | contradicts the assumption that t is a Martin-Lof test in sense 1 [Definition |(70)[ . To 
show that x fails /, suppose otherwise. Since x G 0(B) = 0(WftQ\), there is n > with 

x 0(W /(n) ) = O((J{t -1 (j70 : m > "}) = € B : 4(6)1 > n + 1}). 
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But a; £ 0({b G B : t(b)±> n + 1}) implies that {t(x[n]) : n G iV and i(x[n])|} is bounded, 
which contradicts the assumption that x fails i [Definition |(75)[ . □ 

(82) Proposition: If a real is Martin-Lof random in sense 1 then it is Martin-Lof random 
in sense 2. 

Proof: Suppose that real x is not Martin-Lof random in sense 2. We will show that x is not 
Martin-Lof random in sense 1. Since x is not Martin-Lof random in sense 2 there is total 
recursive g : N — > N such that: 

(a) for all n G N, Pr(W g ( n) ) < 2~ n 

(b) x G f]{0(W g{n) : n G N). 

Let total recursive / : N — > N be such that /(n) = ^(n + 1). Then: 

(83) (a) for all n G N, Pr(W f{n) ) < 2"( n+1 ) 
(b) x G f]{0(W f(n) : n G N) 

Define (possibly partial) recursive function t : B — > N such that for all b G B, = |6| iff 6 G 
Wfnu), with i(6) j if b £ Wfrwy To see that t is a Martin-Lof test in sense 1, let m G N 
be given. Let Z = {b G B : t(b) i> m}. Then Z = {b G B : |6| > m A b G C 
Wj (m ) U W/( m+ i) So by |(83)6 ] and Lemma [(5^1 



i=m+l v 7 v 7 



which exhbits t as a Martin-Lof test in sense 1. By |(83jb J {t(x[n]) :tieJV and t(x[n]) | } is 
unbounded, hence x fails t by Definition [(75)] □ 

(84) COROLLARY: A real is Martin-Lof random in sense 1 if and only if it is Martin-Lof 
random in sense 2. 

Henceforth we proceed in sense 2. That is: 
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(85) Convention: By a test is henceforth meant a Martin-Lof test in sense 2 [as described 
in Definition |(78)[ . Likewise, a real is called Martin-Lof random iff it is Martin-Lof 
random in sense 2. 



13 Universal tests 

(86) Definition: A test / is universal just in case for all reals x, if x fails any test then x 
fails /. 

(87) Theorem: There is a universal test. 

To prove the theorem, call tests / and g congruent iff for all n G N, W / f( n ) = Wg(n)- 
Congruent tests may not be identical since they might exploit different indices for the same 
recursively enumerable set. Plainly: 

(88) Lemma: Tests congruent to each other are failed by the same set of reals. 
Let tfi be the usual indexing of partial recursive functions. 

(89) Lemma: There is total recursive h : N ->■ N such that for all i e N: 

(a) for all n G N, ifcp h{i) (n)i then Pr(W Vh(%)(n) ) < 2~ n ; and 

(b) if ifi is a test then tphti) is a test that is congruent to ifi. 



Proof of Lemma \(89)\ Informally, here is how to compute h. Let i be given. Then h(i) is an 



effectively constructed index for the TM L that behaves as follows. Given n G N, L computes 
ifi(n). If (fi(n) f then L(n) j. Otherwise, suppose that (pi(n) = m. Then L constructs 
an index for the longest initial segment of the canonical enumeration of W m whose sum of 
probabilities remains bounded by 2~™. Therefore, Pr( W Vh .( n ) ) < 2~ n . Now suppose that <pi 
is a test and let n G N be given. Then <pi(n) I so L(n) I. Moreover, Pr{W LPi ^) < 2~ n so 
W <Ph(i){n) = W ^(n)- Hence ip h ^ is a test, and congruent to c^. □ 



21 



Proof of Theorem \(87)\ Let h be as described in Lemma [(89)| Given i, n G N, define X(i, n) 
to be (j +n ) if this set is defined, = otherwise. By Lemma [(89^ 1 Pr(X(i,n)) < 

2 -(i+n)_ Hence: 

(90) For all n G N, Pr\J{X(i, n) : i G N} < 2 ~ n ~ i = 2 ~ n ££i 2_i = 2 ~™ 

A universal test / may now be defined as follows. Given n € N, / dovetails the enumerations 
of W^ h(i) (i+n)> « G N, to uniformly effectively construct an r.e. index f(n) for \J{X(i, n) : i G 
iV}. Thus: 

(91) For all n G N, W /(n) = U{^(^ n) : i € iV}. 

By |(90) [ / is a test. To see that / is universal, suppose that real x fails test g. We must show 
that x fails /. By Lemma [(89^|b J let i G N be such that g is congruent with tphu). By Lemma 
p8)| x fails that is: 

(92) zen{0(W Vfc(()(n) ):neN}. 

To show that x G fl{0(W7( n )) : n S N}, and thus complete the proof, it suffices to show that 
x G 0(W f{n) ) for given n G N. But by [(92)J x G 0(W^ ( . )(i+B) ). So x G 0(X(i,n)) C 
0(U{X(i, n) : z G iV}) = 0(W> W ) by[(9T)] □ 



(93) COROLLARY: The probability of the set of Martin-L6f random reals is 1. 



To pr ove the corollary, we rely on two lemmas the first of which may be found in (lOxtobyl . 



19711, Thm. 3.17). 

(94) Lemma: Suppose that A4 is a descending 2-chain of measurable sets of reals. Then 

Pr(C]Ai) = lim Pr{Ai). 

i 

(95) Lemma: For every test / there is a test g such that 

(a) for all i G N, W g{i) D W g(i+1) , and 
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(b) a real fails g if and only it fails /. 
Moreover, an index for g can be found uniform effectively from an index for /. 

Proof: It suffices to let g(n) be an index for Wyvo) H • • • D Wjr n y □ 

Proof of Corollary \(93)\ For all i G N, 0{Wi) is measurable since it is the union of basic open 
sets [namely, [j{0(b) : & € By Theorem |(87)| and Lemma [(95)} let g be a universal test 

such that {Wgi n ) : re G N} forms a ^-descending chain. By Definition |(86)[ real x is Martin- 
Lof-random iff x passes g. By Definition |(79)[ the set of reals that fail g is C\{0(W g ^) : re G 
N}, whose probability is lim^oo Pr(0(W g ( n ))) by Lemma [(94)| By Definition [(78)1 tne l atter 
limit is zero. Hence, the set of reals that pass g has probability 1. □ 



14 Equivalence of the two conceptions of randomness 

It will be shown in this section that a real is random in the sense of Kolmogorov [Definition 
|(66)| | iff it is random in the sense of Martin-Lof [Definition |(79)J. We abbreviate the two senses 
of randomness to "KC" and "ML" (The "C" in "KC" stands for "Chaitin"). 

(96) Proposition: If a real is ML-random then it is KC -random. 



The proof follows iDowney and Hirschfeldtl (I2010l. §6.2). We start with a lemma. 



(97) Lemma: Let TM M have prefix-free domain. Fix k e N, and let S = {b e 
B : K M {b) < \b\ - k}. Then Pr(S) < 2~ k Pr (domain (M)). 

Proof: For each b G S let c& G B be such that |cft| < \b\ — k and M(cft) = b. Then: 

Pr(S) < J]{2-I b l : b G 5} 

< ^{2-(l Cfc l +fc ' : b G S} 
= 2~ k ^2{2~^ : b G S} 

< 2~ k J2{2^ d \ : d G domain(M)} 
= 2~ k Pr (domain M). 
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The first inequality follows from Lemma |(37)| because S is a subset of the prefix-free set 
domain(M). The second inequality comes from the choice of c&. The third inequality follows 
from Cb G domainM. The last equality relies on Lemma [(69)[ □ 

Proof of Proposition \(96)\ Let total recursive / : N — > N be such that for all k G N, 
Wffi) = {b G B : K,(b) < \b\ — k}. A dovetailing construction shows that such an / exists. By 
Lemma [(97)| for all k G N, Pr(W f{k) ) < 2~ k Pr (domain (W f{k) )). Since domain (W f{k) ) C 
domain(F), and the latter set is prefix-free, we have by Lemma |(69)| that Pr(domain (Wf( k )) < 
1. Hence, for all G N, Pr(W f(k) ) < 2~ fe which exhibits / as a Martin-L6f test. Now suppose 
that real x is ML-random. Then for some k G N, x O(Wyvfc)). Hence, for all m G N, 
/C(x[m]) > |6| — fc so x is KC -random by Definition |(66)| □ 

Here is the converse to Proposition |(96)| 

(98) Proposition: If a real is KC -random then it is ML-random. 

Proof: We prove the contrapositive. Suppose that real x is not ML-random. Then there is total 
recursive / : N ->• N such that x G f] n W/( n ) and Pr(W/( n )) < 2 _n . Hence by Lemma [(36)| 
there is total recursive g : N —> N such that x G f] n W g i n ) , and for all n, W g i n \ is prefix-free, 
and Pr{W g{n) ) < 2~ n . So: 

(99) (a) for all n G N, W g ( 2n ) is prefix-free, 

(b) x G r\n w g(2n), and 

(c) for all n G iV, Pr(W 9(2n) ) < 2" 2n . 

From |(99 j^lcl via Lemma [(69)] 

(100) 2_|6 ' ^ 2 ~ 2n - 

beW g(2n ) 

We now show: 

(101) ^ ^ 2"-l & l<l. 

nGAffeGVK g(2n) 
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To demonstrate |( 101 )[ , observe that for all n G N, 

2 n -l b l = V 2 n 2'^ = T V 2~ |b| < 2 n 2~ 2n = 2~ n , 
6GW 9(2n) 6gvk 9(2ti) beW g(2n) 

where the inequality follows from |( 100)1 Summing over n yields [(TOT)) 

Returning to the proof of Proposition |(98)[ let (rii,bi,£i) be a repetition-free, recursive 
enumeration of all triples with G N, 6j G W / 9 (2n i )' an d = — ri». From |(10T)1 and the 
definition of 1^ we infer: 

Hence Lemma [(3 8) | implies that there is a recursive enumeration aj of a prefix-free subset of B 
such that \a>i\ = l{ for all i G N. It follows from the two recursive enumerations that there is 
partial recursive function ijj with domain {a-i :i£N} such that V>( a «) = h for all i G N. Since 
{en : i G N} is prefix-free, so is -0- Thus we have: 

For all n G N and 6 G Wg^n) there is i G N such that |<2j| = \b\ — n and tp(ai) = b. 

It follows immediately that: 

(102) For all n G N and b G W g{2n) , K^{b) < \b\ - n. 

By Proposition |(40)| since -0 is prefix-free, choose c such that for all b G B, /C(6) < /C^(6) + c. 
Then |( 1 02)] implies : 

For all n G N and b G W s(2re ), £(&) < K^,(b) + c<\b\+c-n. 

Substituting for n in the foregoing, we obtain: 

(103) For all k G N and b G W g{2{c+k)) , K{b) < \b\ + c - (c + k) = \b\ - k. 

In view of |(99^|b J for all k G N there ism G N such that x[m] G W g ( 2 (c+k))- So |(103)| implies: 
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For all k € N there is m € N such that K(x[m]) < \x[m] \ — k = m — k. 
By Definition |(66) [ the last inequality shows x not to be KC -random. □ 

(104) Corollary: A real is ML-random if and only if it is CK-random. 
From the preceding corollary and Corollary |(93)[ 

(105) COROLLARY: The set of reals that are random in the sense of Kolmogorov has prob- 
ability 1. 
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